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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

I )[>3 Responsive to communication(s) filed on June 26, 2006 . 

2a)|E This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) £3 Claim(s) 1-30 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-30 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)Q accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

I I )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 
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a)D All b)Q Some * c)Q None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 
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application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Remarks 

1 . The Amendment filed on June 26, 2006 has been received and entered. Claims 1-30 are 
pending. 

2. Applicant's remarks have overcome the previously presented claim objections. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in ( 1 ) an application for patent, published under section 1 22(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

4. Claims 1-2, 4-12, 14-22, and 24-30 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Shteyn (U.S. Pub. No. 2002/0116471 Al). 

As to claim 1 3 Shteyn discloses a method for integrating content, comprising: 
searching the plurality of media sources for content and metadata based on a search 

criteria (See pages 3-4, paragraph 003 1, wherein "search criteria" reads on "time, genre, etc." 

which are all search options except user preference); 

parsing the metadata received from the plurality of media sources, wherein the parsing of 

the metadata is performed in real-time (See pages 3-4, paragraph 0031, teaches parser as part of 
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the system, and see page 4, paragraph 0032, wherein "performed in real-time" reads on 
"immediately"); 

receiving user preference information from a content service provider (See page 4, 
paragraph 0037); 

integrating the content and the metadata according to the user preference information and 
based on the result of the parsing of the metadata (See page 4, paragraph 0031, also see page 4, 
paragraph 0034, and page 1, paragraph 001 1, metadata and user preference represented in user 
profile form a dataset composite); and 

sending the integrated content and metadata to the content provider (See page 4, 
paragraph 0036); and 

rendering the integrated content concurrently using one or more displays (See page 3, 
paragraph 0031). 

As to claims 2, 12, and 22, Shteyn discloses providing the integrated content and the 
metadata to an information presenter (See page 3, paragraph 0031). 

As to claims 4, 14, and 24, Shteyn discloses wherein the plurality of media sources 
comprises one or more of television programs, Internet broadcasts, and web pages (See page 1, 
0005, prior art, also see Figure 1, 140, broadcast device, deemed to broadcast television or 
Internet content). 
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As to claims 5, 15, and 25, Shteyn discloses wherein the process if further to pass the 
metadata resulting from the parsing and an associated content to an information integrator using 
an extensible markup language (XML) (See page 3, paragraph 0023, lines 6-10). 

As to claims 6, 16, and 26, Shteyn discloses wherein the processor is further to pass the 
metadata resulting from the parsing and an associated content to an information integrator via an 
Application Programming Interface (API) (See page 3, paragraph 0024, wherein "API" reads on 
network "interface"). 

As to claims 7, 17, and 27, Shteyn discloses wherein the content is associated with one or 
more metadata descriptions (See page 2 5 paragraph 0017, wherein "title, artist, etc." represents 
metadata descriptions). 

As to claims 8, 18, and 28, Shteyn discloses wherein the content is associated with one or 
more metadata descriptions are created by a multi-modal analysis engine (See page 4, paragraph 
0037, wherein "multi-modal analysis engine" is defined as Multimodal applications represent the 
convergence of content - video, audio, text and images thus reading on "user device" capable of 
receiving different content- i.e. broadcast, Web access, and exchange services). 



As to claims 9, 19, and 29, Shteyn discloses wherein the multi-modal analysis engine 
comprises one or more of the following: 
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a video analyzer, an audio analyzer, and a digital analyzer (See page 3, paragraph 0028, 
teachings plurality of content receivers/analyzers). 

As to claims 10, 20, and 30, Shteyn discloses wherein the processor is further to store the 
integrated content for access at anytime by the user (See page 4, paragraph 0036). 

As to claim 11, Shteyn discloses a system, comprising: 

a memory to store executable instructions (See page 1, paragraph 0006, prior art, also see 
Figure 1, 150, receiver, wherein all user devises (i.e. client) taught in this reference (i.e. set-up 
box, personal computer, television sets, etc.) deemed to include memory); and 

a processor, coupled with the memory (See Figure 2, 220, Processor), the processor to 
execute the instructions to: 

search a plurality of media sources for content and metadata based on a search criteria 
(See pages 3-4, paragraph 0031, wherein "search criteria" reads on "time, genre, etc." which are 
all search options except user preference); 

parse the metadata received from the plurality of media sources, wherein the parsing of 
the metadata is performed in real-time (See pages 3-4, paragraph 0031, teaches parser as part of 
the system, and see page 4, paragraph 0032, wherein "performed in real-time" reads on 
"immediately"); 

receive user preference information from a user (See page 4, paragraph 0037); 
integrate the content and the metadata according to the user preference information and 
based on the result of the parsing of the metadata (See page 4, paragraph 0031, also see page 4, 
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paragraph 0034, and page 1, paragraph 001 1, metadata and user preference represented in user 
profile form a dataset composite); and 

display the integrated content concurrently using one or more displays (See page 3, 
paragraph 0031). 

As to claim 21, Shteyn discloses an article of manufacture comprising machine-readable 
medium having stored thereon instructions which when executed cause a machine to: 

search a plurality of media sources for content and metadata based on a search criteria 
(See pages 3-4, paragraph 0031, wherein "search criteria" reads on "time, genre, etc." which are 
all search options except user preference); 

parse the metadata received from the plurality of media sources, wherein the parsing of 
the metadata is performed in real-time (See pages 3-4, paragraph 0031, teaches parser as part of 
the system, and see page 4, paragraph 0032, wherein "performed in real-time" reads on 
"immediately"); 

receive user preference information from a user (See page 4, paragraph 0037); 

integrate the content and the metadata according to the user preference information and 
based on the result of the parsing of the metadata (See page 4, paragraph 0031, also see page 4, 
paragraph 0034, and page 1, paragraph 001 1, metadata and user preference represented in user 
profile form a dataset composite); and 

display the integrated content concurrently using one or more displays (See page 3, 
paragraph 0031). 
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Response to Arguments 
5. Applicants arguments filed on June 26, 2006 have been fully considered but they are not 
persuasive. 

In response to Applicant's argument that " Shteyn does not teach or suggest parsing the 
metadata received from the plurality of media sources, wherein the parsing is performed in real- 
time" is acknowledged but not deemed to be persuasive. 

The Examiner contends that Shteyn teaches the claimed limitation in paragraph 0032 as 
stated in the office action wherein "immediately" is synonymous with real-time or instantly as 
defined in dictionary.com. Not only does the cited reference explicitly deal with live broadcast 
data that is inherently received in real-time for presentation thus parsed in real-time (either for 
immediate presentation or stored for subsequent presentation), but Shteyn in paragraph 0031, 
teaches meta-information renderer 230 presents the meta-information to a user, and receives user 
directives, based on the rendered meta-information. For example, upon command by a user, an 
electronic program guide may be presented to the user, with options for current or future 
selection and/or recording. 

Furthermore, to Expedite prosecution the Examiner has provided a U.S. Patent No. 
6,877,134 Bl to Fuller et al. titled integrated data and real-time metadata capture system and 
method to show that its well known in the art that broadcast services occurring in real-time will 
be capturing and parsing in real-time metadata. / 



Conclusion 
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6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Neveen Abel-Jalil whose telephone number is 571-272-4074. 
The examiner can normally be reached on 8:30AM-5:30PM EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey A. Gaffin can be reached on 571-272-4146. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. y 



Neveen Abel-Jalil 
July 28, 2006 




